On Spin-Glass Complexity 
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We study the quenched complexity in spin-glass mean-field models satisfying the Becchi-Rouet- 
Stora-Tyutin supersymmetry. The outcome of such study, consistent with recent numerical results, 
allows, in principle, to conjecture the absence of any super symmetric contribution to the complexity 
in the Sherrington-Kirkpatrick model. The same analysis can be applied to any model with a Full 
Replica Symmetry Breaking phase, e.g. the Ising p-spin model below the Gardner temperature. 
The existence of different solutions, breaking the supersymmetry, is also discussed. 

PACS numbers: 75.10.Nr, 11.30.Pb, 05.50.+q 

Mean field spin glass models can display different kinds 
of frozen phase according to the choice of the interaction 
between their constituent elements. Such a phase can 
be either Full Replica Symmetry Breaking (FRSB), i.e. 
described by means of an order parameter that is a func- 
tion of the replica-group index x: the overlap q(x) , or One 
step Replica Symmetry Breaking (1RSB), in which only 
two groups of replicas are necessary for a proper repre- 
sentation of the properties of the system and the overlap 
consequently takes only two values. The prototype of the 
first kind is the Sherrington-Kirkpatrick (SK) model 0, 
whereas for the second kind we will mainly discuss the 
Ising p-spin model, displaying discontinuous overlap at 
the paramagnet/spin-glass transition at temperature T s 
and, moreover, a second 1RSB/FRSB transition deep in 
the frozen phase, at the Gardner temperature Tq [2|. 

Decreasing the temperature from the paramagnetic 
phase, both the SK and the p-spin models undergo a 
transition to a phase where a dynamic aging regime sets 
up. Below the transition temperature the infinite sys- 
tem never equilibrates: dynamical two-time quantities 
such as correlation and response function are not time 
translational invariant and do not satisfy the fluctuation- 
dissipation theorem. However, the nature of the aging 
regime is quite different in the two models. Furthermore, 
in the SK model such transition coincides with the static 
transition, taking place at temperature T s , and, at fi- 
nite temperature, the large time values of one-time in- 
tensive quantities, e.g. the energy, tend to their equilib- 
rium value. In p-spin models, instead, the temperature 
at which the aging regime arises, called T^, is above T s 
and the dynamical energy never converges to its equi- 
librium value, remaining above some threshold E t h- It 
is largely believed that the dynamical features of these 
systems are connected to the presence of a high number 
of metastable states, the logarithm of which, divided by 
the size of the system, is called Configurational Entropy 
or Complexity. 

In this letter we present a quenched FRSB compu- 
tation of the complexity of the SK model based on 
the Becchi-Rouet-Stora-Tyutin supersymmetry (BRST- 
susy). While in 1RSB models the complexity saddle point 



is supersymmetric and finite, in the SK model our compu- 
tation shows that a SUSY solution would be compatible 
only with a subextensive number of metastable states. 
It is reasonable to think that some of the differences be- 
tween the dynamics of the two classes of models amount 
to this difference in behavior of the complexity. 

We will now concentrate on the complexity of the SK 
model, later discussing what insight we can gain from 
the study of the Ising p-spin model. The SK model con- 
sists of N Ising spins connected to each other by random 
variables Jik of variance 1/N. The states of the system 
are usually identified with a proper subset of solutions 
of the Thouless-Anderson-Palmer (TAP) Q equations, 
the computation attempts to count these solutions. The 
TAP equations are mean-field equations for the single- 
site magnetizations {rrii}: 
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Where q = J2i m i/N- They can be obtained extremiz- 
ing the following TAP free energy function F({rrii}) with 
respect to the {nii}: 

0F({m}) = -0Y, JiJ m i m j ~ ^J" (1 - if ( 2 ) 
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Not all TAP solutions can be identified with physi- 
cal states. An important condition is that they must be 
minima of the TAP free energy. Furthermore, in order to 
yield the correct magnetic susceptibility of a state in zero 
external field, i.e. \ = 0(1 — q), the solutions must sa tisfy 
the Plefka criterion x p = 1 - /3 2 XX 1 ~ m f ) 2 / N > 0- 
This criterion is encountered also in the replica com- 
putation of the equilibrium free energy as the central sta- 
bility condition of the saddle point with respect to fluctu- 
ation of the order parameter Q a b, indeed it corresponds 
to the condition of positivity of the replicon eigenvalue. 
Equivalcntly it can be recovered in the context of the cav- 
ity method as the condition of positivity of the spin-glass 
susceptibility X SG = Ey Xij/N 0- 
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We would like to compute the minima of the TAP free 
energy functional satisfying the Plefka criterion. Unfor- 
tunately the only expression one can handle is: 



Ps(f) 



1 N 
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Strictly speaking this corresponds to count all the so- 
lutions of the TAP equations of a given free energy / 
weighted with the sign of the determinant of the Hes- 
sian. Therefore the assumption that this expression cor- 
responds to the number of physical states must be jus- 
tified somehow a posteriori. Through standard manipu- 
lations we can express p s as an integral over fermionic, 
{4>i, ipi}, and bosonic, {m^, Xj |, variables of the exponen- 
tial of the following action [(J LL3| : 

S = x l d mz F{{m})+^ J d t d J F({m}) + u(F({m})-Nf) 

(4) 

The variable u is given by the <5-function over the free 
energy. This action posses the BRST-susy 6j, indeed it 
is invariant under the transformation bmi = e ifti ; 8x t = 
e uipi ; 8ij} i — —e Xi ; Sipi = 0. We can perform annealed 
or quenched averages yielding respectively In pj and In p s ; 
the quenched are the physical ones, i.e. those describing 
the properties of a typical system. They can be com- 
puted through the replica method, considering n copies 
of the system and taking the limit n — > 0. Eventually 
one obtains an integral of the exponential of a 'macro- 
scopic' action <S maC ro depending on four bosonic and four 
fermionic (in case replicated) variables (see e.g. 0). If 
the complexity is extensive the integral may be evalu- 
ated by steepest descent, solving saddle-point equations 
for the macroscopic action. Furthermore, the fermionic 
part always gives a subextensive contribution and can be 
neglected, yielding the well known expression obtained 
more than twenty years ago by Bray and Moore (BM) 

The problem of finding a solution to the saddle-point 
equations obtained in order to extremize the macroscopic 
action is highly non trivial. The annealed case, widely 
studied in the literature 0, HI, [n|, tells us that there 
are different solutions to these equations and we face the 
problem of selecting, if any, the correct one. In particular, 
there is a BRST-susy solution and a BRST-susy-breaking 
solution. The selection problem has been recently con- 
sidered by the authors and it has been shown that all 
solutions currently known for the annealed case present 
some problems. In the quenched case it has been shown 
[lfl | that the complexity curve £(/), if it exists, vanishes 
at the equilibrium free energy. In [llj it has been pointed 
out that such point of the complexity curve is described 
by a BRST-susy saddle point. 

The fermionic, subextensive part, usually neglected in 
the computation of the complexity by means of the sad- 
dle point approximation, is actually very important: tak- 
ing it into account one sees that the macroscopic action 



too is invariant under a proper macroscopic BRST-susy 
transformation between its eight (eventually replicated) 
variables 0] and this causes the prefactor of the expo- 
nential of the BM saddle point to be zero at all orders in 
an expansion in l/N. 

We have studied the quenched complexity satisfying 
the BRST-susy. In Q the existence of a replicated 
BRST-susy-breaking solution is hypothesized, with a 
complexity which goes to zero at the equilibrium free 
energy. This solution, however, has not been exhibited 
up to now. We will come back to this point below. 

Considering a BRST-susy saddle point, considerably 
simplifies the computation of J e' Smacro . Indeed, as al- 
ready discussed in 0, UlL one recovers the computa- 
tion scheme proposed in [3. We, thus, consider the 
replicated expression of the variational free energy used 
to compute the equilibrium free energy, which depends 
on the n x n matrix Q a b- In the limit n — > 0, Q a b is 
parametrized by means of the Parisi Ansatz in terms of 
the function q(x) defined in the interval [0, 1]. We impose 
by hand a break point of q(x) at x — m < astatic (where 
^static is the break point of the Parisi solution) and then 
we extremize the free energy with respect to q(x) ob- 
taining the function F(/3, m). The complexity S(/3, /) at 
a given free energy / is obtained through the following 
equations: 



£(/?,/) =/3m : 
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d(mF(P,m)) 
dm 



(5) 



with 



F(P,m) = ext 



1 - 2q(l) + [ q 2 {x)dx 
Jo 



/(0,0) 



(6) 

The function f{x 1 y) satisfies the Parisi differential equa- 
tion d x f = q/2[dyf + x (dyf) 2 ] with initial condition: 

f{m~,y) = In / dp Aq (z) cosh m (/3y + f3z)dz + ^ 
fim J p 

(7) 

where dp& q (z) is a Gaussian measure over z with zero 
mean and variance Aq which accounts for a possible dis- 
continuity at x — m. We have computed q(x) as a func- 
tion of m and the resulting complexity both by numerical 
integration and by an exact series expansion in powers of 
the reduced temperature through the techniques of 0. 
We find that setting m smaller than the static break point 
^static the function q(x) which extremizes the free energy 
develops a discontinuity at x = m. In general, q(x) is 
a continuous monotonous function for x < m, at some 
xq < m it develops a plateau such that q(x) = q(xo) for 
xq < x < m: in particular q(m~) = q(xo); it displays, 
then, a positive discontinuity Aq at x = m, while it is 
constant for x > m. 

At some m — m max , corresponding to a threshold free 
energy / t h, S(/3, m) takes its maximal value (see figure 
[TJ. We can identify S(/th) with the total complexity. 
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Our most important result is that this solution must 
be rejected on physical ground. In figure ^ the BRST- 
susy quenched complexity is plotted versus / together 
with the BRST annealed complexity 0, |n| . Convexity 
implies that lnpl > lnp s . The total complexities, in the 
annealed and quenched case, can be identified with those 
of the states with higher complexity, i.e. Stot = £(/th) 
and, thus, the previous convexity condition is violated. 
Moreover, convexity implies that at any / the annealed 
complexity must be greater then the quenched one, but 
fth is greater in the quenched case, therefore there is a 
region where the annealed complexity is zero while the 
quenched one is finite thus violating this condition. 

Most importantly, we have checked (details elsewhere 
|2lj ) that the solution does not satisfy the Plefka cri- 
terion, i.e. the replicon eigenvalue is negative as soon 
as to < x s tatic- This means that, provided it actually de- 
scribes some TAP solutions, they have no physical mean- 
ing. As discussed in the violation of the Plefka cri- 
terion leads also to a mathematical inconsistency with 
some assumptions implicit in the solution (i.e. the con- 
dition B — 0, see [HJ). A direct computation shows that 
this result can be extended to generic mean-field models 
with a continuous FRSB q(x). 

Since the solution is unphysical for any / > / cq , we 
obtain that BRST-susy in the SK model implies zero 
complexity. In order to account for a finite complex- 
ity one has to look for another solution (see discussion 
at the end of the letter). In the BRST-susy case the 
number of states is subextensive and the states have all 
the same free energy per spin, equal to the equilibrium 
value. Furthermore all the states verify x p = 0. We no- 
tice that all these properties are in complete agreement 
with both old and recent numerical findings 0, 0] , 
not implying any supersymmetry. In |l6l| the minima of 
the TAP free energy with x p > (i.e. those that can 
be physically identified with states of the system) are 



1 rsb (annealed TAP) 



Full rsb (quenched) 



studied by means of some modified TAP equations 0] 
which allow to separate this set from the non-physical 
solutions, in [l^ the original equations are employed. In 
both cases turns out that all these minima satisfy x p = 0, 
as N — > oo, in disagreement with the prediction of the 
BRST-susy-breaking solution 0,0. We also mention 
that a zero complexity in the SK model was also ob- 
tained in the dynamical reformulation of Parisi solution 
performed in Ref. [l7| . 

The Ising p-spin model is useful to understand the 
different behavior of the complexity in 1RSB and FRSB 
models. This system undergoes a first phase transition 
from a paramagnetic to a 1RSB phase at a temperature 
T s and a second, continuous, phase transition from the 
1RSB phase to a FRSB phase at T G <T S . The replicon 
eigenvalue of the 1RSB solution is positive in the 1RSB 
phase but goes to zero at Tq. At T < Tq the replicon is 
negative on the 1RSB solution while it is strictly zero on 
the FRSB solution. At temperatures Tq < T < T s we 
can compute the quenched complexity using the stan- 
dard recipe of 4j using a 1RSB order parameter. The 
result, see e.g. figure 2, is a quenched complexity which 
is zero at the equilibrium free energy and reaches a max- 
imum value at some f max . However, as noted in [l9j |. the 
replicon eigenvalue, which is positive at / = /o, goes to 
zero at some fc < /max an d is negative at free energies 
/ > /g where the solution must be rejected, see figure 
|2 Thus we identify fa as the free energy threshold at 
that temperature if we stick to the SUSY solution. It 
turns out that limT^T G fc(T) = /o(2~g)- Therefore, ap- 
proaching Tq from above, the range [/o,/g] where the 
complexity is finite shrinks to zero. Equivalcntly, the 
total complexity goes to zero at Tq: lim^ — i r p G £(T) = 



T=0.5 (T G =0.240261) 
3-spin Ising 



FIG. 1: Annealed and quenched complexity of the BRST so- 
lution in SK model. 
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FIG. 2: Complexity of the Ising p-spin model, for p = 3. It 
counts (meta-)stable states up to a value fa, lower than / ma x 
(it would be fa = /max in the spherical p-spin case where no 
1RSB/FRSB transition occurs). Beyond such point the sta- 
bility condition (Plefka's criterion) is violated. In particular, 
fa -> fo as T -> T G . 
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lim T ^ TG E(/ G (T)) = S(/ eq (T G )) = 0. Therefore, at the 
transition from a 1RSB equilibrium phase to a FRSB 
equilibrium phase the complexity vanishes and remains 
zero in the whole FRSB phase. 

We now discuss the possible existence of other 
quenched solutions, such as the one hypothesized in 01 • 
BRST-susy-breaking solutions certainly exist in the an- 
nealed case while they are not known in the quenched 
case. However, as discussed in Refs. 0, Q| they would 
need some justification in order to be used. Taking into 
account corrections to the saddle point it turns out that 
the expansion in powers of 1/N of the prefactor of the 
leading exponential contribution is zero at all orders. 
This result has been obtained by Kurchan 0] for the 
total complexity of the naive TAP equations exploiting 
the BRST-susy of the macroscopic action referred above; 
we have extended this result to the SK model at a generic 
value of u (the variable conjugated to the free energy), 
i.e. at any value of the free energy. Clearly a zero or ex- 
ponentially small prefactor will dramatically change the 
saddle point prediction. Furthermore, according to Q 
the quenched BRST-susy-breaking solution should coin- 
cide with the annealed BRST-susy-breaking solution at 
free energies greater than some f c and it has been shown 
[lll | that this solution does not compare well with the 
numerical data of [lfi. flij ] . In particular, it predicts a 
finite value of x p which is out of the error bars of the 
numerical prediction, which instead hints a zero value. 
Discrep ancy are also found in the support of the com- 
plexity [Ifj. We also mention that in the Ising p-spin 
model at Tq < T < T s a BRST-susy-breaking solution 
similar to the annealed one of the SK model can be found 
|l2| . This solution, however, yields a complexity vanish- 
ing at a free energy different from the equilibrium one at a 
given temperature and violating Plefka's criterion for low 
free energies (see [ilj for details). On the contrary, the 
BRST-susy solution of the Ising p-spin model vanishes at 
exactly the equilibrium 1RSB free energy (Fig. • 

Quite recently it has been shown that the TAP solu- 
tions counted by the BM complexity, besides a strictly 
positive spectrum display an isolated eigenvalue going to 
zero for N — > oo|22|. This property solves the apparent 
violation of the Morse theorem [6j . In general, this result 
shows a substantial difference between the BRST-susy 
and BRST-susy-breaking solution: only the first one de- 
scribes TAP solutions with a strictly positive spectrum. 
Therefore, together with our results, this leads to the 
conclusion that, while in 1RSB systems a BRST-susy 
complexity counts an extensive number of states with 
strictly positive eigenvalues, in FRSB systems the BRST- 
susy solution is unphysical and the BRST-susy-breaking 
solution proposed by BM counts an extensive number of 
configurations with a flat direction out, as N — > oo. 

Regarding the possible existence of quenched BRST- 
susy solutions other than the one we considered, they 
would violate Plefka criterion too, yielding a negative 



replicon eigenvalue. Indeed, a direct computation (de- 
tails elsewhere |2l|) shows that in FRSB models the vi- 
olation of the criterion is caused by the discontinuity at 
x = m, while a continuous function marginally satisfies 
it. On the other hand, if q{x) is continuous at x = m, 
it holds d(F(m, (3)) /dm = and we will not be able to 
apply the recipe of Eq. [SJ The discontinuity at x = m 
is therefore unavoidable in order to have a non trivial 
complexity but, at the same time, it causes instability. 

Looking at the Ising p-spin model we recall that in [Tif 
the existence of states with free energy higher than fc 
has been hypothesized: since the 1RSB solution is unsta- 
ble, the complexity of these states should be described by 
a FRSB solution, much as the equilibrium free energy at 
T < Tq. It is not known whether such a solution actually 
exists but it can be proved that violation of marginal sta- 
bility will occur in the p-spin model as well: q(x) should 
be discontinuous at x = m but at the same time the 
presence of a FRSB region on the left of the discontinu- 
ity will force the replicon to be negative. The pro blem of 
the existence of a complexity of the clusters [l9( in the 
p-spin model remains, instead, open. 
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